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Abstract. Although numerical simulation in lattice field theory is one of the most effective 
' tools to study non-perturbative properties of field theories, it faces serious obstacles coming 

D . from the sign problem in some theories such as finite density QCD and lattice field theory 

with the 9 term. We reconsider this problem from the point of view of the maximum entropy 
0^ ■ method. 
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. 1 Introduction 

l> 

Lattice field theory is a powerful method to study non-perturbative aspects of quantum field 
theory. Although numerical simulation is one of the most effective tools to study non-perturba- 
tive properties of field theories, it faces serious obstacles in theories such as finite density QCD 
and lattice field theory with the 6 term. This is because the Boltzmann weights are complex and 
• this makes it difficult to perform Monte Carlo (MC) simulations on a Euclidean lattice. This 

is the complex action problem, or the sign problem. In the present talk, we review the analysis 
of the sign problem based on the maximum entropy method (MEM) [HO [3]. For details, refer 
to [UG3E]. The MEM is well known as a powerful tool for so-called ill-posed problems, where the 
number of parameters to be determined is much larger than the number of data points. It has 
been applied to a wide range of fields, such as radio astrophysics and condensed matter physics. 

In this talk we deal only with lattice field theory with the 9 term. It is believed that the 
9 term could affect the dynamics at low energy and the vacuum structure of QCD, but it is 
known from experimental evidence that the value of 9 is strongly suppressed in Nature. From 
the theoretical point of view, the reason for this is not clear yet. Hence, it is important to study 
the properties of QCD with the 9 term to clarify the structure of the QCD vacuum [Zl El [S| • For 
theories with the 9 term, it has been pointed out that rich phase structures could be realized 
in 9 space. For example, the phase structure of the Z(N) gauge model was investigated using 
free energy arguments, and it was found that oblique confinement phases could occur [8j [9]. 
In CP^ -1 models, which have several dynamical properties in common with QCD, it has been 
shown that a first-order phase transition exists at 9 = tt \10\ [TT1 [12] . 

In order to circumvent the sign problem, the following method is conventionally employed 
\12\ . The partition function Z{6) can be obtained by Fourier-transforming the topological charge 
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distribution P(Q), which is calculated with a real positive Boltzmann weight: 

zdz\e~ SJ[ 
J[dzdz]e~ 



Q 



where 

J[dzdz] Q e- 



P(Q) 



J dzdze s 

The measure \dzdz\Q in equation ([1]) is such that the integral is restricted to configurations of 
the field z with topological charge Q. Also, S represents the action. 

In the study of CP^ -1 models, it is known that this algorithm works well for a small lattice 
volume V and in the strong coupling region [10\ \TT\ PT3| I14j . As the volume increases or in 
the weak coupling region, however, this strategy too suffers from the sign problem for 9 ~ tt. 
The error in P(Q) masks the true values of 2(9) in the vicinity of 9 = ir, and this results in 
a fictitious signal of a phase transition [131 114j . This is called 'flattening', because the free 
energy becomes almost flat for 9 larger than a certain value. This problem could be remedied 
by reducing the error in P(Q). This, however, is hopeless, because the amount of data needed 
to reduce the error to a given level increases exponentially with V. 

Here, we are interested in whether the MEM can be applied effectively to the study of the 
9 term and reconsider the flattening phenomenon of the free energy in terms of the MEM. The 
MEM is based upon Bayes' theorem. It derives the most probable parameters by utilizing data 
sets and our knowledge about these parameters in terms of the probability. The probability 
distribution, which is called the posterior probability, is given by the product of the likelihood 
function and the prior probability. The latter is represented by the Shannon-Jaynes entropy, 
which plays an important role to guarantee the uniqueness of the solution, and the former is 
given by x 2 - It should be noted that artificial assumptions are not needed in the calculations, 
because the determination of a unique solution is carried out according to probability theory. 
Our task is to determine the image for which the posterior probability is maximized. 

We present the results for the analysis by i) using mock data and ii) using the MC data. For 
the former, we use the Gaussian form of P(Q). The Gaussian form is realized in many cases, 
such as the strong coupling region of the CP^ -1 model and the 2-d U(l) gauge model. For using 
MC data, we simulate the CP^ -1 model and apply the MEM to the obtained data. This paper 
is organized as follows. In the following section, we give an overview of the origin of flattening 
and summarize the procedure for the analysis of the MEM. The results obtained by use of the 
MEM are presented in Section [3l 



2 Flattening and MEM 
2.1 Flattening 

The free energy density f(9) is calculated by Fourier-transforming P(Q) obtained by MC simu- 
lation. Let us call this method the FTM. The quantity f(9) is defined as 



/(e) = -ilny>(Q) e «« 



where V = L 2 , the square of the lattice size. 

The MC data for P(Q) consist of the true value, P(Q), and its error, AP(Q). When the error 
at Q = dominates because of the exponential damping of P(Q), f(9) is closely approximated by 

1 

V 



/(0)~--ln [e-W' + AP(0)] ; 
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where f{9) is the true value of f(9). Because f(9) is an increasing function of 9, AP(0) dominates 
for large values of 9. If |AP(0)| ~ e~ v ^ at 9 = t , then f(9) becomes almost flat for 9 > { . 
This is called "flattening of the free energy density" , and it has been misleadingly identified as 
a first order phase transition, because the first derivative of f(9) appears to jump at 9 = 9{. To 
avoid this problem, we must carry out the order of e v measurements in the FTM. 



2.2 MEM 

In this subsection, we briefly explain the MEM in terms of the 9 term. In a parameter inference, 
such as the x 2 fitting, the inverse Fourier transform 

p(Q) = J] %, z ^y~ m ( 2 ) 

is used. In the numerical calculations, we use the discretized version of equation ([2]); P(Q) = 
KQ tTl Z n , where Kq !U is the Fourier integral kernel and Z n = Z(9 n ). In order for the con- 

n 

tinuous function Z(9) to be reconstructed, a sufficient number of values of 9, which we denote 
by Ng, is required so that the relation Nq > Nq holds, where Nq represents the number of data 
points in P(Q) (Q = 0, 1, . . . , Nq — 1). A straightforward application of the x 2 fitting to the 
case Nq > Nq leads to degenerate solutions. This is an ill-posed problem. 

The maximum entropy method is suitable to solve this ill-posed problem, yielding a unique 
solution. The MEM is based upon Bayes' theorem, expressed as 

P rob(Z(0)|P(Q),I) = P rob(P(Q)|J) ' 

where prob(^4|P) is the conditional probability that A occurs under the condition that B occurs. 
The posterior probability prob(Z (9)\P(Q), I) is the probability that the partition function Z(9) 
is realized when the MC data {P(Q)} and prior information / are given. The likelihood function 
pmb{P{Q)\Z{9),I) is given by 

prob(P(Q)|^),I) = ^e-^ 2 ) 
Xl 

where Xl is a normalization constant and x 2 ls a standard x 2 function. 
The probability prob(2(^)|I) is given in terms of an entropy S as 

pTO b(Z(9)\I) = -± r -e- aS , 
X s (a) 

where a and Xs(ct) are a positive parameter and an a-dependent normalization constant, re- 
spectively. As S, the Shannon-Jaynes entropy is conventionally employed: 



-2n hi 



n=l 

Here m n = m(9 n ) represents a default model. 

The posterior probability pvob(Z n \P(Q), I), thus, is given by 

1 i2c e w W 
V vob(Z n \P(Q),I,a,m) = - - . . e~^ +«5 = 



X L X s {a) ~ X L X s (a) 

For the prior information I, we impose the criterion 

Z n > 0, so that prob(i? n < 1 1, a, m) = 0. 

The most probable image of Z n , denoted eis Zryi , is calculated according to the following proce- 
dures [am. 
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1. Maximizing W[Z] to obtain the most probable image Z n °^ for a given a: 



SZ n 



W[Z] 



z=z( a ~> 8Z n 



1 



-X +aS 



z=z( a ) 



0. 



2. Averag ing 2sli ^ to obtain the o^-indcpcnclcirt most probable image Z n \ 

Z n = j da Z { n a) piob(a\P(Q),I,m). 

The range of integration is determined so that the relation 
prob(a\P(Q),I,m) > prob(d|P(Q),/,m)/10 

holds, where proh(a\P(Q), I, m) is maximized at a = a. 

3. Error estimation: The error of the most probable output image Z n is calculated as the 
uncertainty of the image, which takes into account the correlations of the images Z n among 
various values of 9 n : 



((5Z n ) 2 ) = J da ((6Z^) 2 ) W ob(a\P(Q),I,m). 



(3) 



Here 5Z n and SZn represent the error in Z n and that in Zn , respectively. 



3 Results 



3.1 Mock data: Gaussian 

Firstly, we present the results of the analysis by using mock data. For this, we use the Gaus- 
sian P(Q) as 



P(Q) = A exp 



V 



Q~ 



where, in the case of the 2-d £7(1) gauge model, c is a constant depending on the inverse 
coupling constant [3, and V is the lattice volume. The constant A is fixed so that ^ P(Q) = 1- 

Q 

The distribution P{Q) is analytically transformed by use of the Poisson sum formula into the 
partition function 



-2-pois($) 



E ex p 



(4) 



To prepare the mock data, we add noise with variance 5 x P(Q) to the Gaussian P(Q). In the 
analysis, we consider sets of data with various values of 6 and study the effects of S. 

In Fig. [1] the Gaussian topological charge distribution and corresponding f(9) obtained by 
using the FTM are shown for various lattice volumes. For small volumes, the behavior of f(6) 
is smooth. For large volume (V = 50), however, clear flattening is observed. For V = 30, some 
data are missing. This is due to the fact that Z(9) could take negative values because of large 
errors. This is also called flattening, because its origin is the same as that stated above. 

For the P(Q) data corresponding to small volumes without flattening, the MEM successfully 
reproduces f(9). Fig. [2] displays Z{9) for V = 50 by using the MEM. Here, the Gaussian default 
m(9) = exp [— 7^r# 2 ] with 7 = 5.5 is used. The result of the MEM does not show flattening 
but smooth behavior, in agreement with the exact result calculated by equation @ (Poisson). 
In contrast, the FTM yields flattening. See [1] for details. 
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Figure 1. Gaussian topological charge distribution and corresponding f(8) obtained by using the Fourier 
method (FTM) for various lattice volumes [3]. The parameter 5 is chosen to be 1/400. 
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Figure 2. 2(0) (crosses) with the error bars for the Gaussian default model with 7 = 5.5 [4j. Here, 
V = 50. Compared to the result of the FTM (circles), a remarkable improvement is clearly seen. 



3.2 MC data 

In this subsection, we apply the MEM to real Monte Carlo data by simulating the CP 3 model. 
(For details, see [6].) For this we used a fixed point action |15| 1 16] and various lattice volumes 
L x L. Among these, we concentrate on the data for L = 38 as the non-flattening case and 
L = 50 as the flattening case. We systematically studied the flattening phenomenon by adopting 
a variety of default model m(9) and prior probability of the parameter a. For the latter, g(a) 
dependence appearing in 

pvob(a\P(Q),I,m) = P(a) oc g(a)e w(a)+A{a) , 

is investigated. The function g(a) represents the prior probability of a and is chosen according 
to prior information. In general, two types of g(a) are employed, one according to Laplace's 
rule, <?Lap(oO = const, and one according to Jeffrey's rule, gj e f(a) = l/a. The latter rule is 
determined by requiring that P(a) be invariant with respect to a change in scale, because a is 
a scale factor. The former rule means that we have no knowledge about the prior information 
of a. In general, the most probable image Z(9) depends on g(a). We investigate the sensitivity 
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Figure 3. Z Lap (0) and -Z Je f(0) for 6 e [2.0, tt] 0. 
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Figure 4. The most probable images Z(8) for various m(6') 
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of Z{9) to the choice of g(a) by studying a relative difference 



A(9) 



\Z Lap (9) - Z Jci (9)\ 
(Z Lap (9)+Z Jci (9))/2' 



(5) 



where Z\^ &p (9) and Zj e f(9) represent the most probable images according to Laplace's rule and 
Jeffrey's rule, respectively. 

In the case without flattening (L = 38), the MEM yielded images Z(9) that are almost 
independent of m(9) and g{a). The most probable images Z{9) are in agreement with the result 
of the FTM within the errors. 

In the case with flattening (L = 50), we found that the statistical fluctuations of Z(0) become 
smaller as the number of measurements increases except near 9 = tt. We also found that Z{9) 
with large errors depends strongly on g{cz) in the region of large 9, where the g(a) dependence 
of Z{9) was estimated using the quantity A(0). For 9 < 2.3, Z{9) agrees with the result of the 
FTM. For 9 > 2.3, Z{9) behaves smoothly, while the FTM develops flattening. In Fig. [3] , we 
compare Z(9) in larger values of 9 for ^Lap(a) and <7j e f (a) when two different Gaussian default 
models are used (7 = 5.0 and 13.0). It is noted that 7 = 5.0 is the case in which the smallest 
values of A(0) in equation ([5]) are observed in this 9 region among various default models. 

Our results are summarized in Fig. HI All the results obtained using the MEM behave 
smoothly over the entire range of 9. Errors are estimated from uncertainties of the images 
according to equation ([3|). For larger values of 9, Z{9) depends strongly on m{9). Each of these 
images could be a candidate for the true image. This m{9) dependence of Z(9) may reflect the 
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flattening phenomenon. If we had proper knowledge about m{6) as prior information, we could 
identify the true image in a probabilistic sense. Such knowledge may also allow us to clarify 
the relationship between the default model dependence and the systematic error, which is not 
included in the figure. This will be a task to be pursued at the next stage. 

The MEM provides a probabilistic point of view in the study of theories with the sign problem. 
It may then be worthwhile to study lattice QCD with a finite density in terms of the MEM. 
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